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SYSTEM AND METHOD OF IMAGING THE CHARACrERISTICS OF AN OBJECT 

Ink. t Patent- och les.* 

BACKGROUND OF THE INVENTION 

7003 -10-0 

S [0001] The present patent application relates to the field of imaging the characteristics of 
an object, and particularly to a measuring system allowing for detecting defects of an 
object by Imaging the characteristics of the object having at least a first and a second 
layer as well as a method for such detection. 

10 Pcscriptioti of the Related Art 



[0002] Quality control Is very Important in for Instance the packaging industry. Most 
manufacturers perform a manual visual inspection of the products^ i.e. examining the 
products with the human eye. This Is time consuming, expensive, hot veiy efRclent and 
15 may be considered to be a $ul>|ecdve evaluation. An alternative to the manual quality 
inspection Is to use an automated inspection system. However, the inspection of 
transparent or semi-transparent materials is difficult since defects on these materials are 
invisible to normal inspection systems. 

20 [0003] One method of Inspecting transparent objects, such as glass or plastics, is to use a 
brlght-field/dark-fleld system. The bright-field Is the region where specular reflected light 
from the object is Imaged on a sensor. The dark-field is the region In which diffusely 
reflected light from the ofarfect is imaged on a senson The ^gnals from the dark- and bright- 
field sensors can be used to detect defects on the surface of transparent objects. When no 

25 defect Is present, the bright-field image is bright and the dark-field image Is dark. But 
when the object has a defect, ttie dark-field Image presents an increased brightness. 
However, this method of Inspecting transparent objects only detects defects on a surface 
^ layer. 

* * M 

a • • 

- 30 [0004] One prior art approach Is disclosed In EP 902 275, which suggests an imaging 
: apparatus and process for Inspecting an object wrapped in a transparent or seml- 

transparent material, such as a cigarette package wrapped in a polymeric flim. Incident 
"fl"^* '® directed upon the object such that the light enters the wrapper and the wrapper 
acte as a waveguide. The light escapes from the poly film wrap at edges and folds where 
. - .35 it reaches a reflecdve boundary. The escaped light is captured by a camera and is 
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thereafter sent to an Imaging processor. Thus, overwrap defects^ such Hy^WtlipKk^ilWBWB, 
misfoldfng, tearing, wrinkling or other defects, will be detected. 



[OOOS] However, this prior art approach only detects defects In a wrapping layer. Defects 
5 on the package Itself niust be separately inspected at a separate stage requiring mora 
than one inspection system, manual or automatic. 

[ 0006] Therefore, there is a need for a system and a method for the detection of defects 
on an object comprising at least two layers, where at least the first layer consists of a 
1 0 transparent or semi-transparent material. 

SUMMARY OF THE INVEMTIOM 

[0007] Accordingly, it is an object of the present Invention to provide an improved 
15 measuring system allowing for Imaging the diaracterlstics of an object having at least a 
first and a second layer. 

[0008] This object is achieved through providing a measuring systenni comprising at least 
one light source arranged to Illuminate the object with incident lights an Imaging sensor 

20 arranged to detect reflected light from the object and to convert the detected light into 
electrical charges and, means for creating a representation of the object according to the 
electrical charges, wherein the device comprises means for obtaining Information on light 
scattered in the first layer and the second layer of the object from the representation 
and, means for comparing the information to stored information in order to detect 

25 defects on the object. 



£0009] Another object of the invention is to provide an improved method tor imaging the 
characteristics of an object having at least a first and a second layer. 

. 30 [0010] This object is achieved through a metiiod of providing a measuring system. In 
which the object Is Illuminated by means of Incident light, and light reflected from the 

: object Is detected by means of an innaging sensor in which the detected light is converted 

: \: Into electrical charges, according to which a representation of the object is created, 

z"[: whereby Information on light scattered In at least a first layer and a second layer of the 

. .-35 object is obtained from the representation and that the information Is compared to stored 

: Information In order to detect defects on the object. 
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[0011] still other objects and features of the present Invention wll^ecome a^^rent 
from the following detailed description considered In conjunction with the accompanying 
. drawings, it is to be understood, however, that the drawings are designed solely for 
purposes of Illustration and not as a definition of the limits of the Invention, for which 
5 reference should be made to the appended claims. It should be further understood that 
the drawings are not necessarily drawn to scale and that, unless otherwise Indicated, 
they are merely intended to conceptually Illustrate the struOures and procedures 
described herein. 

BRIEF DESCRlPTtON OF THE DRAWIIiSS 

10 

[0012] In the drawings, wherein lllce reference characters denote slmlldf elements 
throughout the several views: 

[0013] Fig. 1 discloses a schematic view of a measuring system according to a first 
IS embodiment of the Invention; 

[0014] Rg. 2a discloses a view of an object to be examined showing how light normally 
scatters In the different layers In a first example of how defects are detected and 
classined with the inventive system; 

20 

[0015] Fig 2b discloses how light scatters when a second layer of an object to be 
examined has a defect according to the first example corresponding fig. 2a; 

[0016] Fig 3a discloses a view of an object to be examined showing how light normally 
25 scatters In the different layers In a second example of how defects are detected and 
classified with the Inventive system; 

[0017] ng 3b discloses how light scatters when a second layer of an object to be 
examined has a defect according to the second example corresponding fig. 3a; 

[0018] Fig 4a discloses a view of an object to be examined showing how light normally 
scatters In the diffierent layers In a third example of how defects are detected and 
: \- classified with the inventive system; 



[0019] Fig 4b discloses how Hght scatters when a first layer of an object to be examined 
has a defect according to the third example corresponding fig. 4a; 
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[0020] Fig. Sa discloses a schematic view of a measuring system according to the first 
embodiment of the invention, where an object to be examined comprises a defect? 



[0021] Fig 5b discloses a captured Image on a two-dimensional sensor over an object to 
5 be examined shown in fig. 5a; 



[0022] Rg 5c discloses the measured intensities of the captured Image shown In fig. 5b; 

[0023] Fig. 6 discloses a schematic view of a measuring system according to a second 
10 embodiment of the Invention^ where a three-dimensional image is obtained; 

[0024] Rg. 7a discloses a schematic view of a measuring system according to the second 
embodiment of the invention, where an object to be examined comprises a defect; 

IS [0025] Rg 7b discloses a captured Image on a two-dimensional sensor over an object to 
i>e examined shown In fig. 7a; 



20 



[0026] Rg 7c discloses the measured IntenslQes/range profile of the captured Image 
shown in fig 7b. 

DETAILED DESCRIPTION OF THE PRESENTLY PMERRED EMBODIMENTS 



[0027] Figure 1 Is a conceptual diagram showing a basic constitution of a measuring 

system 1 for imaging the characteristics of an object 2 having at least a first 2a and a 

25 second 2b layer according to a first embodiment of the present Invention. The s^em 1 

comprises at least one light source 3 arranged to illuminate the object 2 with Incident 

light 4. An imaging sensor 6 is arranged to detect reflected light 5a and 5b from the 

object 2 and to convert the detected light Into eledrtcal charges. Reflected light which Is 

detected by the imaging sensor 6 is denoted 5b and, light scattered In the object which is 

, 30 detected by the Imaging sensor 6 Is denoted 5a. The system ftjrther comprises means for 
» • * 

creating an analogue or digital representation of the object 2 according to the electrical 
: chargesy such as an image/slgnal-piDcessing unit (not shown). Said means for creating 

: \* the analogue or digital representation of the object 2, may either be a separate unit or 

Integrated In the imaging sensor 6. In the preferred embodiment of the present 
t :*.3S Invention, a digital representotlon of the object 2 Is created* 



[0028] The object 2 and the measuring system 1 are moved In relation to one another in 
a predefined direction of movement on parallel planes, preferably in a substantially 
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horizontal direction. In the preferred embodiment of the present Invention the object 2 
moves relative to the measuring system 1. The object 2 may e.g* be placed on a 
conveyor belt which moves or alternatively there is no belt and the object itself moves, 
for example. If said object Is paper In a continuous web In a paper-making machine. 
5 Instead of the object 2 moving relative to the measuring system 1, the relaBonship may 
naturally be reversed, that is to say the object 2 is stationary and the measuring system 

1 moves over the object 2 when measuring. In still another embodiment both the object 

2 and the measuring system 1 move In relation to each other. 

10 [0029] Tlie Inddent light has limited dispersion in at least one direction. Thus, the light 
source 3 generate, for example, point light, linear light or light composed of multiple, 
substantially point or linear segments and may be of any type suitable to the application, 
for example a laser, a light-emitting diode (LED), ordinary light (light bulb), which are 
familiar to the person skilled In the art and will not be further described herein. 

15 

[0030] The light source 3 comprises in one embodiment of the present invention a 
polarizer (not shown), which polarises the incident light 4. This facilitates In making a 
distinction between reflected and scattered light, since the reflected light also will be 
polarized but the scattered light will be polarised to a lesser degree. When the light 
20 source 3 comprises a polarizer, it is necessary to use a sensor that distinguish between 
light polarized in different directions. 

[0031] The imaging sensor 6 may be a CCD camera, a CMOS camera, or any other 
sensor suitable for imaging characteristics of an object, 

25 

[0032] The system further comprises means fbr ob^ining information on light scattered 
In the first layer 2a and/or the second layer 2b of the object 2 from the digital 
representation. This read out information is a>mpared with stored information, such as a 
threshold value. In order to d^ect defects on or in the object 2, e.g. the light intensity In 
^ 30 each point of the digital representation may be compared to a predetermined value. The 
type of defect can in this manner be classified. Other well-lcnown classification methods 
' are of course possible to use, such as comparing the relative light Intensity between two 

adjacent points of the digital representation with a predetermined value, etc. 

35 [0033] The object 2 may for example be a laminated product comprising two or more 
different materials or, comprising two or more layers of the same material assembled 
with different directions of the grsin of the material. Or, may be a package wrapped In a 
tiBnsparent or semi-transparent material, such as a foil, which may l>e laminated or 
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unlaminated. More examples are food wrapped in or covered by a transparent or senr^i- 
transparent material, such as a plastic, or an electronic component, such as a printed 
circuit board/ covered by a protecting layer. The thickness of the layers may be equal or 
different. The first layer may be only a layer of lacquer. The Invention ts not limited to 
5 any specific example of objects. The Invention Is based on that some materials scatter 
light very well and that the scattered light Is affected by the underlying or overiying 
material (layer). 



[0034] Some examples of detected and classified defects are listed t>elow and illustrated 
10 In figures 2a-4b. All of the illustrated examples comprise two layers, but the Invention 
worlcs well on objects having more than two layers. Information of the object to be 
inspected is stored. I.e. what the ^normar Image on the sensor should look like (how 
light normally Is reflected and scattered). Depending on which divergence from the 
''normal'' image the captured Image has, the type of defect can be classified. 

15 

[0035} Figures 2a and 2b Illustrates a first example of a defect detected and classified by 
the inventive system, where the first layer 2a transmits light and the second layer 2b 
scatters light. Figure 2a shows incident light 4 which hits the first layer 2a, some of the 
Incident 4 light Is reflected and some of It enters the first layer 2a. The entered light is 
20 transmitted through the first layer 2a and enters the second layer 2b where It Is 
scattered. The scattered light re-enters the first layer 2a, is transmitted therethrough 
and leaves the first layer 2a whereby It Is detected by the sensor 6 (shown in figure 1). 

[0036] If, however, the second layer 2b has a defect, there will be a reduction of the 
25 scattered light detected by the imaging sensor. In this simplified example, shown In 
figure 2b, the sensor will only deteA reflected light. 

[0037] Figures 3a and 3b illustrates a second example of a defect detected and classified 
by the inventive system, where both the first layer 2a and the second layer 2b transmit 
. 30 light. Incident light 4 hits the first layer 2a some of which is reflected and some of which 
enters the first layer 2a. The entered light is transmitted through the first layer 2a and 
: enters the second layer 2b, through which It is also transmitted. 

* m 

[0038] If, however, the object 2 Is delamlnated, I.e. there Is a space between the first 2a 

♦ ,'P5 and the second 2b layer, there will be an Increase of scattered light detected by the 

: Imaging sensor, shown In figure 3b. This is due to the reflection of the light on the 
:./ second layer 2b leading to increased scattered light. 
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[0039] Rgures 4a and 4b Illustrates a thfrd example of a defect detected and classified 
by the Inventive systenr), where the first layer. 2a scatters light and the second layer 2b 
transmits light. Incident light 4 hits the first layer 2a some of which is reflected and^some 
of whfch enters the first layer 2a. The entered light is partly transmitted through the first 
5 layer 2a and partly scattered therein. The scattered light leaves the first layer 2a and is 
detected by the imaging sensor. The transmitted light enters the second layer 2b and is 
transmitted therethrough. 

[0040] If, however, there Is a defect on the first layer 2d sudi as a mtsslng piece, tliere 
10 will be a reduction of scattered light detected by the imaging sensor. In the example 
shown in figure 4b, only reflected light on the second layer 2b Is detected by the imaging 
sensor. 

[0041] Another example (not shown] of a defect detected and classified by the inventive 
IS system. Is where the first layer scatters light and the second layer 2b reflects light. If 
there 1$ a defect on the second layer, such as a missing piece, a reduction of the 
scattered light will be detected by the Imaging sensor. 

[0042] Figure 5a Illustrates the measuring system according to the first embodiment of 
20 the present invention corresponding to figure 1. The system 1 comprises at least one 
light source 3 arranged to illuminate the object 2 with incident light 4. An inniaging sensor 
6 is arranged to detect reflected light from the object 2. In this embodiment the light 
source 3 has generated a line of light 7 across the object 2. The object 2 comprises a 
defect 8 which In figure 5a Is located within the field of view (FoV) of the Imaging sensor 
25 6. 

[0043] The Image of the object in figure 5a captured on the two-dimensional sensor 6 is 
shown m figure 5b. The sensor detects both the light scattered In the regions Bl and B2 
in the object 2 and the reflected light A on the ol^ect 2. Rgure 5b shows the line of light 
^ 30 7 (shown in figure 5a) as A, On both sides of the reflected light A an area of scattered 
light appears which can be seen fn figure 5b. 



35 



[0044] If the light source 3 comprises a polarizer, the regions .81 and 82 may be moved 
closer to the line of light A on the object 2 without cross-talk between the reflected and 
scattered measurements. This enables detection of small defects. 
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[0045] The Intensities (signal strengths) or the reflected light A end the scattered light B 
in the captured image In figure 5b are shown in figure 5c. The indicated defect 8 which 
yields an Increased scatter Is clearly visible In figure 5c. 

5 [0046] If the complete Image Is retrieved from the sensor, the processing to find the 
Intensity of the scattered and reflected light is made by an external signal-processing 
unit. The output of raw sensor Information llmltS/ however^ the possible sampling speed. 
If the sensor has random access capability it is possible to extract only the interesting 
regions from the sensor, thus retrieving a smaller amount of data from the sensor and a 
10 possibility to reach a greater sampling speed. With some sensors ft is also possible to 
have different exposure time and/or read-*out amplification for the two regions and also 
to sum the scattered light from a number of rows to further increase the signal strength. 

[0047] The scattered light may be collected on one side, Bl or B2, of the reflected light 
IS or summed up from both sides, Bl and BZ, to further Increase the signal strength. If a 
point light source Is used, a multitude of positions may be used together or independent 
of each other to determine the amount of scattered light. Thus, information on the main 
direction of the scattered light may be obtained. 

20 [0048] Figure 6 shows a setup of the Inventive measuring system according to a second 
embodiment of the present Invention. In this embodiment, ttie system 1 comprises one 
light source 3 arranged to illuminate the object 2 with Incident light 4. An imaging sensor 
6 is arranged to detect reflected light 5a and 5b from the object 4 and to convert the 
detected light into electrical charges. Reflected light which is detected by the Imaging 
25 sensor 6 is denoted 5b and, light scattered in th^ object which Is detected by the imaging 
sensor 6 ts denoted Sa. The system further comprises means for creating an analogue or 
digital representation of the object 2 according to the electrical charges, such as an 
image/slgnal-proce^lng unit (not shown). In the preferred embodiment a digital 
representation is created. Said means for creating the digital representation of the object 
. 30 2, may either be a separate unit or integrated In the Imaging sensor 6. In this setup of 
the measuring system 1, the light source 3 is placed at a distance away from the Imaging 
: sensor 6 in order to besides obtaining information on scattered light also obtaining 

: information on the geometric profile oF at least one of the layers 2a or 2b of the object 2 
from the digital representation. 



.•-35 



[0049] The Information on the geometric profile of the object 2, I.e. the object shape 
Information, is obtained by using trianguiation. I.e. the position of the reflected light 
indicates the distance from the sensor 6 to the object 2. 
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[0050] The setups In figures 1 and 6 comprise a single light source 3. It Is, however 
obvious for the person skilled in the art that more than one light source can be used. For 
example. In the second embodlnrient of the present Invention shown in figure 6, different 
light sources may be used for the three-dimensional (geometry) and the two-dimensional 
S (scattered light) Images. This can even increase the imaging speed in some cases. 

[0051] Figure 7a illustrates the measuring system according to the second embodiment 
of the present Invention corresponding figure 6. The system 1 comprises at least one 
light source 3 arranged to Illuminate the object 2 with Incident light 4. An imaging sensor 
10 6 Is arranged to detect reflected light 5 from the object 2. In this embodiment the light 
source 3 has generated a line of light 7 across the object 2. The object 2 comprises a 
defect 8 which in the figure 7a is located within the field of view (FoV) of the Imaging 
sensor 6. 

IS [0052] The Image of the object In figure 7a captured on the two*dimensionat sensor 6 is 
shown in figure 7b. Figure 7b shows the line of light 7 (shown In figure 7a) as A. On both 
sides of the reflected light A an area of scattered light appears which can be seen, in 
figure 7b. The sensor detects both the light scattered In the regions Bl and B2 In the 
object 2 and the reflected light in A on the object 2. The shape (geometry) of the object 

20 2 Is shown with the bold line A In figure 7b. The geometry of the object Qndlrated with C 
in figure 7c) follows line A, t.e« the reflected light. The regions Bl and B2 are in parallel 
with line A. 

[0053] The intensities (signal strengths) of the reflected light A and the scattered light B 
25 In the captured Image In figure 7b are shown in figure 7c. The Indicated defect 8 which 
yields an increased scatter is clearly visible in figure 7c. Rgure 7c further shows the 
range profile C extracted from the shape of A shown In 7b. 



[0054] in the following will be described a method for Imaging the characteristics of an 
^ 30 object having at least a first and a second layer by means of a measuring system. In 

'.^ • which method the object Is Illuminated by means of Incident light, and light reflected 
: from the object Is detected by means of an imaging sensor in which the detected tight Is 

: \: converted Into electrical charges, according to which a representation of the object Is 

f : created, wherein information on light scattered in the first layer and the second layer of 
« • • 

. .*.3S the object* Is obtained fi^m the representation and that the Information Is compared to 
stored information In order to detect defects on the object. 
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[0055] In a further embodiment of the method the measuring system and/or the object 
Is/are moved In relation to one another In a predefined direction of movement* 

[0056] In another embodiment the method further comprises the step of obtaining 
5 information on the geometric profile of the object from the representation, either the first 
layer of the object or the second layer of the object. 

[0057] In still another embodiment the method further comprising the step of using 
polarized Incident light In order to fadlitate the disUncUcn between reflected light on the 
.10 object and scattered light in the ol^ect. 

[0058] As Illustrated by the above, a measuring system and a method for imaging the 
characteristics of an object having at least a first and a second layer by means of the 
measuring system has been described, where defects may be detected In both the first 
15 and the second layer. The approach according to the pr^ent invention being 
advantageous in comparison to the previously discussed prior art approach, whld> 
detects defects In only a wrapping layer of an object The present Invention eliminates 
these restrictions of such a prior art approach through enabling the detection of defects 
in either one of the first and the second layer of the object or both. 

20 

[0059] Thus, while there have been shown and described and pointed out fundamental 
novel features of the invention as applied to a preferred embodiment thereof. It will be 
understood that various omissions and substitutions and changes in the form and details 
of the devices Illustrated, and In their operation, may be made by those skilled in the art 
25 without departing from the spirit of the invention* For example, it is expressly Intended 
that all combinations of those elements and/or method steps whidi perform substantially 
the same function In substantlaliy the same way to achieve the same results are within 
the scope of the Invention, l^oreover, it should be recognized that strucbires and/or 
* elements and/or method steps shown and/or described in connection with any disclosed 
^ 30 form or embodiment of the Invention may be incorporated in any other disclosed or 
described or suggested form or embodiment as a general matter of design choice. It is 
: the Intention, therefore, to be limited only as Indicated by the scope of the claims 
; appended hereto. 
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CLAIMS 

1. A measuring system (1) for Imaging the characteristics of an object (2) having at 
least a first (2a) and a second (25) layer, which system (1) comprises at least one 
light source (3) arranged to lUumlnate the object (2) with incident light (4), an 
Imaging sensor (6) arranged to detect reflected light (5b) from tha object (2) and 
to convert the detected light Into electrical charges and, means for creating a 
repr^entation of the object (2) according to the electrical charges, characterised 
in that the system (1) comprises means for obtaining information on light 
scattered (5a) in the first layer (2a) and the second layer (2b) of the object (2) 
from the representation and^ means for comparing the information to stored 
information In order to detect defects on the object (2). 

2. A measuring system according to claim 1, characterised in that the measuring 
system (1) and/or the object (2) is^are.arranged to move In relation to one another 
in a predefined direction of movement 

15 

3. A measuring system according to claim 1, characterised In that the Incident light 
(4) is arranged to have limited dispersion in a predefined direction. 

4» A measuring system according to claim 3, characterised in that the Incident light 
20 (4) Is a linear light. 

5. A measuring sysirem according to claim 1/ characterised in that Hie system 
further comprises means for obtaining information on the geometric profile of the 
object (2) from the representation. 

25 

6« A measuring system according to claim 5, characterised In that the system 
comprises means for obtaining Information on the geometric profile of the first layer 
(2a) of the object (2) from the representation. 

'•[:30 7. A measuring system according to claim 5, characterised in that the system 
comprises means for obtaining information on the geometric profile of the second 
layer (2b) of the object (2) from the representation. 



5 



10 
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8. A measuring system according to claim 1, characterised in that the light source 
(3) comprises a polarizer arranged to facilitate the distinction between light 
reflected on the object (2) and scattered light In the object (2). 

S 9. A measuring system according to claim 1/ characterised In that the first layer 
(2a) consist of a transparent or semi-transparent material. 



10. A measuring system according to claim 1^ characterised in that the object (2) is 
a pacicage wrapped in a protective material. 

10 

11. A method for imaging the characteristics of an object having at least a first and a 
setxind layer by means of a measuring system, in which method the object is 
Illuminated by means of incident light, and light reflected from the object is 
detected by means of an Imaging sensor In which the detected light is converted 

IS into electrical charges, according to which a representation of the object is created, 

characterised in that Information on light scattered in the first layer and the 
second layer of the object Is obtained from the representation and that the 
Information is compared to stored information in order to detect defects on the 
object. 

20 

12. A method according to claim 11, characterised in that the measuring system 
and/or the object is/are moved in relation to one another In a predefined direction 
of movement. 

25 13. A method according to claim 11, characterised In that also Information on the 
geometric profile of the object is obtained from the representation. 

14. A mediod according to claim 13, characterised in that information on the 
geometric profile of the first layer of the object Is obtained from the representation. 

30 

15. A method according to claim 13, characterised in that Information on the 
: geometric profile of the second layer of the object Is obtained from the 
' ] : representation. 

.♦.35 16. A method according to daim 11, characterised In that the inddent Ught is 
/: polarized and that the polarized inddent light is used to distinguish betwe^ 

reflected light on the object and scattered light in the object. 
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A system and method for imaging the characteristics of an object (Z) having at least a 
first (2a) and a second (2b) layer. The object (2) is Illuminated by means of incident light 
(4), and light (5b) reflected from the object (2) is detected by means of an Imaging 
sensor (6) in which the detected light Is converted into electrical charges, according to 
5 which a representation of the object (2) Is created. InformaOon on light scattered (5a) in 
the first layer (2a) and the second layer (2b) of the object (2) is obtained from the 
representation and this information is ^mpdred to stored information in order to detect 
defects on the object (2). 
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